[dagster-airlift] Fix materialization reporting order for tasks #23326
Conversation
This stack of pull requests is managed by Graphite. Learn more about stacking. |
|
Consider |
dpeng817
force-pushed
the
dpeng817/fix_materialization_reporting_order
branch
2 times, most recently
from
421e541 to
b853b76
Compare
dpeng817
force-pushed
the
dpeng817/fix_tests
branch
from
eec0f12 to
6a7ab7b
Compare
dpeng817
force-pushed
the
dpeng817/fix_materialization_reporting_order
branch
from
b853b76 to
b7f87ae
Compare
examples/experimental/dagster-airlift/dagster_airlift/airflow_utils.py
Outdated
Show resolved
Hide resolved
dpeng817
force-pushed
the
dpeng817/fix_materialization_reporting_order
branch
from
b7f87ae to
259d879
Compare
dpeng817
force-pushed
the
dpeng817/fix_materialization_reporting_order
branch
from
259d879 to
f3527fb
Compare
|
Deploy preview for dagit-storybook ready! ✅ Preview Built with commit 259d879. |
|
Deploy preview for dagster-docs ready! Preview available at https://dagster-docs-3iias1ctj-elementl.vercel.app Direct link to changed pages: |
|
Deploy preview for dagit-core-storybook ready! ✅ Preview Built with commit 259d879. |
dpeng817
changed the title
| @@ -217,9 +218,12 @@ def airflow_dag_sensor(context: SensorEvaluationContext) -> SensorResult: | |||
| "Link to Run": MarkdownMetadataValue( | |||
| f"[View Run]({airflow_webserver_url}/dags/{dag_id}/grid?dag_run_id={dag_run['dag_run_id']}&tab=details)" | |||
| ), | |||
| "Creation Timestamp": TimestampMetadataValue( | |||
There was a problem hiding this comment.
Consider "Event Creation Timestamp"
Fixes the materialization reporting order for asset keys mapped from airflow tasks to instead be topological.
Added a very basic test where a dependency between two tasks should always yield the downstream task being added after the upstream.